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This paper proposes an effective technique to solve Distribution System 
Expansion Planning (DSEP) problem by using the artificial neural network. 
The proposed technique will be formulated by using mean-variance analysis 
(MVA) approach in the form of mixed-integer quadratic programming 
problem. It consists of two layers neural network which combine Hopfield 
network and Boltzmann machine (BM) in upper and lower layer respectively 
named as Modified BM. The originality of the proposed technique is it will 
delete the unit of the second layer, which is not selected in the first layer in 
its execution. Then, the second layer is restructured using the selected units. 
Due to this feature, the proposed technique will improve time consuming and 
accuracy of solution. Referring to the case study demonstrated in this paper, 
the significance outputs obtained are the improvement in computational time 
and accuracy of solution provided. As the solution provided various of 
options, the proposed technique will help decision makers in solving DSEP 


Neural network problem. As a result, the performance of strategic investment planning in 


DSEP certainly enhanced. 
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1. INTRODUCTION 

Planning of distribution system has been a very hot topic in the 21st century [1]. Distribution System 
Expansion Planning (DSEP) is dealing with the continuous increasing load demand. In DSEP, the stages of 
the plan and overall time span; the methods of treating distribution feeders and substations in terms of cost 
representation, location and sizing problems; radiality and voltage drop considerations; and the mathematical 
programming techniques used to solve this problem [2]. It uses a fundamental economic criterion, the ‘cost- 
benefit analysis’, in a heuristic selection process of plan options, starting from the terminal year and 
propagating backward to the initial year, to arrive at a plan solution [3]. 

On the other hand, the demand for electricity has grown due to the rapid economic development and 
gradual increase in the world’s population [4]. According to Malaysia Statistic Energy Handbook [5], the total 
generating capacity in Peninsular Malaysia is 24,105 MW. It is predicted that if the current global energy 
consumption pattern continues, the world energy consumption will increase by over 50% before 2030 [6]. 
Since the demand keeps increasing, thus a meticulous planning should be provided to enhance the power 
delivery to the consumer. 

Efficient operation and planning of power systems become more important for a reliable and 
sustainable electricity supply [7]. Optimization is playing a vital and dominant role in the electric power 
system. Optimization problems in power system are diversified and can be categorized in terms of the 
objective function characteristics and type of constraints [8, 9]. Basically, system failure is caused by lack of 
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maintenance. Thus to prevent any electrical failure, maintenance on electrical equipment is important and 
should be taken as a precautionary measure [10], [11]. Since maintenance costs are significant portion of the 
investment planning problem, so, an efficient tool is needed to minimize misdirected investment. In real 
situations, investment planning problems are complicated and non-linear program. Thus, soft computing is a 
valid and convincing approach to solve the problem. 

Previous research papers have appeared to solve DSEP problem by using soft computing and 
mathematical optimization techniques. Tafreshi et al. [12] proposed Genetic Algorithm (GA) to calculate the 
optimum system configuration that can achieve the customers required loss of power supply probability 
(LPSP) with a minimum cost of energy (COE) while Falaghi [13] used the same approach to solve multistage 
DSEP which solved installation of substations, feeders and DG that suit to capacity expansion. Another 
approach that consists the capability of solving DSEP is Artificial Immune System (AIS) that proposed by 
Souza et al. [14]. AIS produced a systematically set of solutions and able to solve DSEP problem in planning 
smart grid and obtaining DG optimal solution. Mixed Integer Linear Programming (MILP) that solved by 
Simulated Annealing (SA) is proposed by Popovic et al. [15] while Tabu Search proposed by Ramirez-Rasado 
et al. [16] to solve DSEP problem. 

The MVA approach is used to solve the portfolio selection problem in this paper. The formulation 
that proposed by Markowitz is in the form of mixed integer programming problem which minimising the risk 
while the return has been fixed into a certain condition. Since the problem is hard to solve, thus soft 
computing approach wil be use by employing the combination between Hopfield Network and Boltzmann 
Machine named as Modified BM. The further explanation will be discussed in Section 2. Section 3 provided 
the discussion based on the simulation result. Lastly, Section 4 will be explaining the conclusion and future 
recommendations. 


2. MATHEMATICAL MODEL 
2.1. Mean-Variance Analysis 

The MVA is a quantitative tool that allows the decision maker to make asset allocation by 
considering the interchange between expected return rate and the measure of risk [17-19]. 
The portfolio optimization employed mean and variance that solved expected return rate for each asset, 
standard deviation which is measure of risk and covariance matrix between these assets. The output is in form 
of the efficient frontier where the expected return greater than any other with the same or lesser risk [20]. 
Basically, MVA is formulated as mixed-integer programming problem as in Equation (1) to (4). 
Formulation 1 


minimize Oij Xi Xj 
isl j=l (1) 
subject tO ex >R (2) 
i=l 
>: =] 
ial (3) 
x20 =, 2,...,n) (4) 


where R is the least acceptable rate of expected return, o;; is the covariance between stock i and j, pi; is the 
expected return rate of stock i and x;, x; is the investment rate for stock i and j respectively. 
Formulation 2 

Based on Formulation 1, the optimal solutions are offered with the least risk. However, the constraint 
faced by the decision maker is the given value cannot exceed the expected return rate. 
The investment rate for each stock determined the solution with the least risk under the given expected return 
rate. Since the risk are evaluated under the condition of fixing the rate of expected return and lead to decision 
maker dissatisfaction, thus Formulation 2 is proposed as in Equation (5) to (10). 


n 
maximize >) sami xi 
int (5) 
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where S is the desired number stocks to be selected in the portfolio, mj,mj; is the decision variable for stock i 
and j respectively where m, is 1 if any stock i is held and m; is 0 otherwise, oj; is the covariance between 
stock i and j, fj; is the expected return rate of stock i and x;,x,; is the investment rate for stock i and j 
respectively. 

In Formulation 2, there are two objective works that have been comprised which are the expected 
return rate and risk. Since Formulation 2 is in the form of mixed-integer programming problem, hence an 
appropriate technique is invented. The combination of Hopfield network and BM is formulated to achieve the 
quality solution by changing over the portfolio into energy function. 


2.2. Boltzmann Machine 

A BM is an interconnected neural network proposed by G. E. Hinton [21]. This model is based on a 
Hopfield network. BM is the updated version of Hopfield network that employed simulated annealing to 
escape the local optimum. The probability rule in BM is used to update the state of neuron and energy 


function. If y,(¢+1) is an output value of neuron! in next time t+1) V,(t+l) is 1 according to the probability 


P which is shown in the following. Meanwhile, y,(¢+1) 1s 0 according to the probability 1—P. 


U;(t) 
PIV,¢+DI= f(-——) 
T (1) 
where V; is the state of unit i, f(-) is the sigmoid function, u;(t) is the total input to neuron i and T is the 
network temperature (control parameter). 


ui(t) = >i wiVi(t) -4 
jal (12) 
where w;; is the weight of the connection from neuron j to neuron i, V;: is the state of unit j and @; is the 
threshold of neuron i. 
The energy function, which is proposed by J. J. Hopfield, is written in the following equation: 


E=13 wivvi-Sav. 
oi A (13) 
2.3. Modified Boltzmann Machine 

Theoretically, Hopfield network can solve the mixed-integer programming problem within minimal 
period of time despite providing less accurate and optimum solutions. On the other hand, Hopfield network is 
easily trapped into the local minimum, thus a modification was made by employing simulated annealing to 
escape the local minimum in the form of BM [22], [23]. The advantage of BM is it can select the optimum and 
accurate solutions since it yields the global optimum solutions and at the same, it requires more computational 
time. The idea of Modified BM is originally taking into account the advantages of both BM and Hopfield 
network. Hopfield network in the upper layer will select units quickly, and then the lower layer which is BM 
will choose the selected units from the upper layer. It will be restructured using those selected units. Based on 
MVA theory, the condition for x; to sum to (not that for each x; cannot be less than (0). 
The condition equation is rewritten where the total of investment rates of all units is 1. 
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(14) 
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Next, the condition equation and the expected return equation are transformed into energy function as 
in Equation (16) and (17) respectively. 


E= {SS Sw So 
i=l 


i=l j=l 


ia jal (16) 
E= 1 S¥onm SS m0] -\ x + KY yx 
i=l j=l i=l j=l i=l isl (17) 


where K is in the range from 0 to 1. 


Equation (18) and (19) represent the objective function that has been converted into energy function 
for the upper layer, E,, and the lower layer, E;. The upper layer is called as “supervise layer” meanwhile the 


lower layer is used to decide the optimal units from the limited selected in upper layer. It is called as 
“executing layer”. 


E,= 5 Sassi +K, > Lisi 


i=l j=l i=l 


(18) 


E,= {SS So + 2s +K,> pox 
i=! i=l 


ial jal il jal (19) 


Based on Equation (18) and (19), K,, and K; represented the weight for expected return rates for both 
upper and lower layer respectively. Figure 1 shows the flowchart for the algorithm of Modified BM. 
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Figure 1. Algorithm of modified BM 
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2.3. Data and Analysis 

There are 13 states in Malaysia that have been taken with their 15 years average interruption 
durations, in which portfolios of investment can be analyzed and optimized. The analysis of interchange 
between interruption duration and variance that employed MVA and Modified BM is more efficient as the 
number of states is increased dramatically. Decision makers are concerned with risk and return, thus these 
should be measured for the portfolio as a whole. 
The simulation steps are listed as follows: 
The temperature T of the Boltzmann machine is moved decrementally from 100 to 0.0001. 
The change is implemented with an interarrival temperature of 0.001. 
The initial setting for each unit is 0.1. 
The constant K = Ku = K1 is simulated for 0.3, 0.5, 0.7 and 1.0. 
As the Boltzmann machine behaves probabilistically, the result is taken to be the average of the last 
10,000 trials. 
The following steps are described as the process of implementing the proposed technique: 


PRO Te 


Step 1.Determining the Right Uncertainty 
The MVA process is initiated by determining the right uncertainty. In this case, the uncertainty is the 
average interruption duration for each state within 15 years in Malaysia. 


Step 2.Quantifying Individual Uncertainties 

The following data that has been quantified as in Table 1 is the average interruption duration by the 
state in Malaysia. The data was collected per hour per customer per year within 15 years from 2001 to 2015. 
In DSEP, the optimal maintenance for each state is decided by referring to average interruption duration. 


Table 1. Average Interruption Duration by State 








2015 | Mean 
0.98 | 2.24 
0.96 | 2.02 


0:94 | 1.69 | 


Kuala Lumpur 
Melaka 
N. Sembilan 
P. Pinang 

















Putrajaya 
Selangor 
Terengganu 















































Step 3. Post-processing the Uncertainties 

The next step is post-processing the uncertainties. In this step, the quantified uncertainties have to 
undergo the process of mean and variance calculation. Table 2 shows the covariance matrix for the 
interruption duration index for each state in Malaysia. 


Table 2. Covariance Matrix of Average Interruption Duration for Each State in Malaysia 


J Kuala N. P. : Putra- 
[Fe fen] ee nn] [Se [Te 
[xedan [1.187] 0976] 0714 | 0412 | 0500 | ose7 | ose | 0661 |oser| 0200] 0007 | o471 | o2a7_| 


| Melaka | 0.470 | 0.693] 0.162 | 0.192 | 0.773 | 0.780 | 0.093 | 0.962 | 0.028| 0.095] -o.001 | 0142 | 0.122 | 


| o2ee | 0.375 | 


0. 
P. Pinang o26e | 0.375 


1.162 | 0.661 | 0.707 0.483 | 0.362 0.494 0.754 | 1.470 | 0.528} 0.531 0.063 
0.984 | 0.627 | 0.650 0.288 | 0.028 0.077 0.586 | 0.528 | 0.851 | 0.265] 0.036 
0.272 | 0.299 | 0.450 0.178 | 0.095 0.019 0.897 | 0.531 | 0.265] 0.749] 0.118 
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Step 4. Applied Portfolio Theory 

In order to enable the decision maker to solve DSEP problem, a set of assets is used to maximize 
return while considering risk aversion. The specific class of optimization is quadratic optimization based on an 
appropriate balance of risk and returns. These risks and returns are typically derived from historical average 
interruption duration. The quadratic programming problem can be solved by MVA that employed Modified 
BM efficiently. 


Step 5. Determining the Optimal Maintenance Strategy 

The results offer sets of solutions following an efficient frontier which the optimal solution can be 
chosen. The decision maker can find an indifferent curve between the value and the uncertainty that accurately 
reflects his interest. Table 3 shows the simulation result for investment rate for each state in Malaysia while 
Table 4 is the table of computational time comparison between conventional BM and Modified BM. 


Table 3. Simulation Result for Investment Rate for Each State in Malaysia 








States K=0.3 K=0.5 K=0.7 K=1.0 
Johor 0.317 0.289 0.242 0.204 
Kedah 0.229 0.237 0.261 0.270 
Kelantan 0.000 0.000 0.018 0.034 
Kuala Lumpur 0.000 0.000 0.000 0.000 
Melaka 0.000 0.000 0.000 0.000 
N. Sembilan 0.000 0.000 0.000 0.009 
P. Pinang 0.000 0.000 0.065 0.135 
Pahang 0.248 0.201 0.173 0.118 
Perak 0.206 0.176 0.119 0.077 
Perlis 0.000 0.000 0.000 0.000 
Putrajaya 0.000 0.000 0.000 0.000 
Selangor 0.000 0.097 0.122 0.132 
Terengganu 0.000 0.000 0.000 0.021 





Table 4. Computational Time Comparison Between Conventional BM and Modified BM 
Computational times (sec) 





Number of states 





Conventional BM Modified BM 
10 7.21 6.42 
40 12.11 8.52 
80 20.08 10.03 
160 43.41 12.61 
320 100.14 20.07 
640 223.01 39.96 





3. RESULTS AND DISCUSSION 

The simulation result for each state in Malaysia was tabulated as in Table 3.0. During K equal to 0.3, 
there were only four states selected which are Johor with the highest portion of the investment, 31.70% 
followed by Pahang with 24.80%, Kedah and Perak with 22.90% and 20.60% respectively. As the value of K 
was increased to 0.5, the selected states were increased as well. The selected states are Johor, Kedah, Pahang, 
Perak and Selangor with 28.90%, 23.70%, 20.10%, 17.60% and 9.70% respectively. The simulation was 
repeated by changing the value of K to 0.7. In this situation, there were seven states chosen which are Kedah 
with the highest portion of 26.10% and Kelantan with the least portion of 1.80%. Meanwhile Johor should 
receive 24.20%, Pulau Pinang with 6.50%, Pahang with 17.30%, Perak with 11.90% and Selangor with 
12.20%. 

There were nine states selected as the value of K equal to 1.0. 20.40% of investment should be 
received by Johor, 27.00% for Kedah and 3.40% for Kelantan. The least portion goes to Negeri Sembilan with 
0.90% only. Pulau Pinang, Pahang and Perak should receive 13.50%, 11.80% and 7.70% respectively 
followed by 13.20% for Selangor and last but not least 2.10% for Terengganu. 

According to Table 3.0, there were four level of risk aversion, K which is 0.3, 0.5, 0.7 and 1.0 that 
reflected the different preferences of the decision maker. Noticed that the value of K influenced the number of 
states chosen where the selected states are high as the value of K increased. A decision maker can determine 
the optimum solutions where the larger value of K leads to riskier option while the small value of K leads to 
conservative ones. Since this proposed technique is flexible, thus it produced a strategic planning investment 
to solve DSEP problem. 
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In order to demonstrate the efficiency of the proposed technique, a comparison was made for the 
computational time between conventional BM and Modified BM as tabulated in Table 4.0. Based on the table, 
the conventional BM consumed 7.21s compared to 6.42s for the Modified BM when the number of state equal 
to 10. As the number of state was set to 160, the Modified BM consumed 12.61s only while conventional BM 
needed 43.41s to complete the task. When the number of state was 640, the conventional BM consumed 
223.01s meanwhile Modified BM consumed less than a minute which is 39.96s only. Notice that, the 
conventional BM required time-consuming compared to Modified BM. This is due to the Modified BM 
deleted useless units during the restructuring step. By contrast, a conventional BM computes all units until the 
termination condition is reached. Comparing computing efficiency, the Modified BM is more efficient, 
especially when the initial number of unit is large. The proposed technique provides a more effective selection 
by using the Hopfield network in the upper layer to choose a limited number of unit, and the BM in the lower 
layer to decide the optimal solution from the limited number of unit selected by the upper layer. 


4. CONCLUSION AND FUTURE RECOMMENDATION 

In this paper, the Modified BM can deal well with DSEP problem that consists of 
mixed-integer programming problem. By following the investment expenses rate for each state as proposed, 
the cost saving can be increased. The results also show that the proposed technique for incorporating structural 
learning into BM is effective and can enhance the decision-making process. 

Other than that, the appropriateness of Modified BM has been verified as the proposed technique able 
to solve the problem of choosing the most potential states to receive the investment. As the result, the 
proposed technique can successfully determine the optimal solutions for each stated at different K. The 
simulation results also show that there is significant decrease in computational time compared to original BM. 

In future, several further works could be explored to enhance the effectiveness of the proposed 
technique. Recently, data is being generated in large amount with varying number of quality, hence the term 
of big data was used. Nowadays, big data has started to affect the lives of modern day in almost every area, 
whether engineering, investment, business, education or healthcare. Since the proposed technique can yield 
the optimum solution for large unit number with fast computational time, thus the Modified BM is highly 
suitable to solve the big data problem. The data is suggested to undergo a specific tool that can help to 
eliminate the redundancy so that it can require less computational effort and time-consuming. 
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